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Abstract 

We study the generic and typical ranks of 3-tensors of dimension I x m x n 
using results from matrices and algebraic geometry. We state a conjecture about 
the exact values of the generic rank of 3-tensors over the complex numbers, 
which is verified numerically for l,m,n < 14. We also discuss the typical ranks 
over the real numbers, and give an example of an infinite family of 3-tensors of 
the form I = m,n = (m — l) 2 + 1, m — 3, 4, . . ., which have at least two typical 
ranks. 

2000 Mathematics Subject Classification. 14A25, 14P10, 15A69. 

1 Introduction 

The subject of tensors, their rank and the approximation of tensors by low rank 
tensors became recently a very active area of pure and applied mathematics. See 
the reference section of this paper. 2-dimensional tensors, which are identified as 
matrices, are well understood theoretically and numerically. Tensors of dimension 
greater than 2, are much more complicated theoretically and numerically than ma- 
trices. Basically, matrices are strongly connected to linear operators, while tensors 
are strongly connected to the study of polynomial equations in several variables, 
which are best dealt with the tools of algebraic geometry. Indeed, there is a vast 
literature in algebraic geometry discussing tensors. See for example [4, Chapter 
20] and references therein. Unfortunately, it is unaccessible to most researchers in 
applied and numerical analysis. 

The object of this paper three-fold. First, we give a basic introduction to one of 
the most interesting topics: the rank of 3-tensors. Second, we state our conjecture 
for the generic tensors of 3-tensors over the complex numbers. Third, we give general 
results for the typical ranks of 3-tensors over the real numbers. We illustrate the 
strength and generality of our results by comparing them to the known results in the 
literature. The novelle results of this paper are obtained by using results on matrices 
and basic results of algebraic geometry on polynomial equations over complex and 
real numbers. For reader's benefit we added a short appendix on complex and 
real algebraic geometry. The exact references for the results in complex and real 
algebraic geometry used in this paper are given in the appendix. 
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' Dedicated to the memory of Gene Golub 
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This paper is written for the audience who has the knowledge of matrix theory 
and was only occasionally exposed to the study of polynomial maps in several com- 
plex variables. This paper is an expanded version of the talk I gave in Workshop on 
Algorithms for Modern Massive Data Sets, sponsored by Computer Forum of the 
Stanford Computer Science Department, NSF and Yahoo! Research, June 21-24, 
2006, [10]. 

We now survey briefly the contents of this paper. §2 deals with the basic notions 
of the tensor product of three vector spaces over any field F, 3-tensors and their 
rank. Theorem 2.4 gives a simple and useful characterization of the rank of a given 
tensor over any field F, in terms of the minimal dimension of a subspace spanned 
by rank one matrices, containing a given subspace L of F mxn . §3 introduces the 
notion of the generic rank in C lxmxn , denoted by grank(Z, m, n). (grank(Z, m, n) 
is a symmetric function in l,m,n.) §4 introduces the notion of the maximal rank 
in c^ xmxn ; denoted by mrank(Z, m, n). §5 gives known values for grank(7, m,n) 
and states the conjectured values of grank(/, m,n) in the range 3 < / < m < 
n < (m — l)(n — 1) — 1. This conjecture is verified numerically for all values of 
l,m,n < 14. (Compare these results with the numerical results for grank(7, m, n) 
given in [7, Table 1], for the values / < 4, m < 5,n < 12.) §6 shows how to apply 
some results on matrices to obtain bounds on grank(/, m, n) and mrank(7, m, n). §7 
discusses the notion of typical ranks of real tensors M /xmxn ; which are the analogs 
of generic rank over the complex numbers. In this case one has a finite number 
of typical ranks taking all the values from grank(/, m,n) to mtrank(Z, m, n). The 
typical ranks for the case I = 2 < m < n are known. For m < n there is one 
typical rank which is equal to grank(2, m,n) = min(n, 2m). For 2 < m = n there 
are two typical ranks grank(2, m,m) = m and mtrank(2, m, m) = m + 1. See [28] 
and [31]. In this paper we give another countable set of examples of the form 
3 < / = m, n = (m — l) 2 + 1, m = 3, . . ., where the maximal typical rank is strictly 
bigger than grank(m, m, (m — l) 2 + 1) = (m — l) 2 + 1, i.e. there are at least two 
typical ranks in these cases. The case m = 3 is studied in [30]. It is shown there that 
mtrank(3, 3, 5) = 6. (It is not known that if mtrank(Z, m, n) < grank(/,m,n) + 1, 
which holds in all known examples.) §8 gives a concise exposition of facts in complex 
and algebraic geometry needed here, with suitable references. 

2 Basic notions and preliminary results 

In this section we let F be any field. Usually we denote by a bold capital letter a 
finite dimensional vector space U over F, unless stated otherwise. A vector u G U 
is denoted by a bold face lower case letter. A matrix A G F mxn denoted by a capital 
letter A, and we let either A = [a^-]™*!^ or simply A = [a^]. A 3-tensor array 

T £ W lxmxn is denoted by a capital calligraphic letter. So either T = [t ijk ] )=-Z k=1 
or simply T = [t ijk \. 

Let Ui,U2,U3 be three vectors spaces. Let m; := dimUj be the dimension 
of the vector space Uj. Let u^j, . . . , VL mi ,i be a basis of Uj for i = 1,2,3. Then 
U := Ui (g> U2 <8> U3 is the tensor product of Ui, U2, U3. U is a vector space of 
dimension m\m2m^, and 

u^,! <8> Ui 2j2 <8> Ui 3)3 , ij = 1,. .. ,mj,j = 1,2,3, (2.1) 
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is a basis of U. For any permutation a : {1,2,3} — > {1,2,3} the tensor product 
U CT (!) <8> U CT ( 2 ) <X> U (T (3) is isomorphic to U. Hence it will be convenient to assume 
that 

1 < fill < 777-2 < 777-3, (2-2) 

unless stated otherwise. A 3-tensor is a vector in U. We will call 3-tensor a tensor, 
and denote it by a Greek letter. A tensor r has the representation 

mi,m,2,rn 3 

T = Y ^1W3 U W,1 ® Uj 2 ,2 ® U i3)3 , (2.3) 
«1=«2=«3=1 

in the basis (2.1). If the basis (2.1) is fixed then r is identified with T = [iiii 2 i 3 ] G 

jpmiXTO2Xrri3 

Recall that xi (g) X2 <8> X3, were x« G Uj,i = 1,2,3, is called a ranA; one tensor, 
or an indecomposable tensor. (Usually one assumes that all Xj 7^ 0. Otherwise 
= xi (g) X2 <8> X3 is called a rank zero tensor.) (2.3) is a decomposition of r 
as a sum of at most 777177727773 rank one tensors, as U^^u^^ (8) Uj 2i 2 <8> Uj 3i 3 = 
(t^ijjgUj^i) (g) Uj 2i 2 <8> Uj 3i 3. A decomposition of r / to a sum of rank one tensors 
is given by 

k 

t = <g) yj ® Zj, Xi G Ui,y, G U 2 ,Zj G U 3 , i = 1, . . . , k. (2.4) 

i=i 

The minimal A; for which the above equality holds is called the rank of the tensor r. 
It is completely analogous to the rank of matrix A = [a^] G F miXrn2 , which can 
be identified with 2-tensor in Y^=&Li a iii 2 u ii,i ® u «2,2 G Ui <8> U2. It is well known 
that, unlike in the case of matrices, the rank of a tensor may depend on the ground 
field F. In particular, by considering the algebraic closed field C versus R, one may 
decrease the rank of the real valued tensor r. 

For j G {1,2,3} denote by f := {p,q} = {1, 2, 3}\{j}, where 1 < p < q < 3. 
Denote by Ujc = U/p ? \ := U p (8) U ? . A tensor r G Ui <8> U2 <8> U3 induces a linear 
transformation r(j) : Ujc — >■ Uj as follows. Assume that u^;, . . . , u m;> ; is a basis in 
U; for I = 1,2, 3. Then any v G Ujc is of the form v = YT p =i^=i v ipi q u i P ,p ® u i„,g- 
Define 

m,j m p ,m q 

T U) v=J2(Yl *n*2i 3 %iJ u ^J- ( 2 - 5 ) 

The rankjr is £/ie ranA; 0/ ZTie operator r(j). Equivalently, let ^4(j) = [<tyi-] G 
Y m P m i xm i ; where each integer Z G [l,m p m g ] corresponds to the pair (i p ,i q ), for 
i p = 1, . . . , 777 p , i g = 1, . . . , m 9 , and ij G [1, m^] n N. (For example arrange the pairs 
(i p ,iq) in the lexicographical order. Then i p = \^-] and i q = I — (i p — l)m q .) 
Set an. = ti x i^i z . Then rankjr = rank^4(j). Associating a matrix A(j) with the 
3-tensors is called unfolding r in direction j. The following proposition is straight- 
forward. 

Proposition 2.1 Let r G Ui<g>U2<X>U 3 6e awen by (2.3). Fix j G {1,2,3}, f = 
{p,q}. LetTi-j := [t hi2 i 3 ]™^ q q =l G W m r xm «,ij = l,..., mj . Then rankjr is tfie 
dimension of subspace of m p x m 9 matrices spanned by T±j, . . . , T mj j. 

The following result is well known. 
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Proposition 2.2 Let r G Ui©U2©U3. Letrj := rankjr /or j = 1,2,3. Denote 
by < R± < R2 < R3 the rearranged values ofr±, r2, r3. T/ien -R3 < rank r < R\R2- 

Proof. We first show that r 3 < rank r. Since 11^1 © Uj 2i 2 G it follows 

that the decomposition (2.3) is a decomposition of T3 to a sum of rank one linear 
operators from U| 12 } to U3. Hence r 3 < rank r. Let j G {1,2,3},j c = {p, q}. 
Recall that U is isomorphic to U' := U p © U g © Uj. Hence rj < rank r for j = 1, 2. 
Thus i?3 < rank r. 

Let Vij, . . . , v\ >r . be the basis of Xj := Tj(U p <8>U g ) C Uj. It is straightforward 
to show that r G Xi © X2 © X3. So Tj : X p © X g — >■ Xj. Assume that i?i = r^. 
Decompose Tj = z i ® x '> where z; G X p © Xq,x; G Xj for / = 

Since zi G X p © X ? , it follows that each z; is at most a sum of i? 2 rank one tensors 
in X p © X g . Hence r is a sum of at most R1R2 rank one tensors in Xi © X2 © X3. □ 

The following proposition is obtained straightforward: 

Proposition 2.3 Let the assumptions and the notations of Propositions 2.1-2.2 
hold. Let [v^i, . . . , v mi) i], [vi i2 , • • • , ^m 2 ,2\ be two bases in Ui, U2 respectively, where 

[Ul,l, • • • , U mij i] = [Vi,!, . . . , V mi) i]Qi, [Ul,2, • • • , U m2i2 ] = [Vl,2, • • • , V m2i2 ](32, 

Qi = [q Pq ,iQ=i e GL(mi,F), Q 2 = fe 9 , 2 ]^ =1 G GL(m 2 ,F). 

Let 

mi ,7712,013 

r= Yl UjkVi,i®v j ,2®u j>3 , f k>3 := M"«eF m ' xm2 , k = l,...,m 3 . 

i,j,k=l 

Then T fci3 = Q\T k ^Ql for k = 1, . . . , m 3 . 

Ze£ [vi ; 3, . . . , v m3) 3] 6e another basis 0/U3, where 

[ui >3 , . . . , u m3i3 ] = [vi )3 , . . . , v m3i3 ]Q 3 , Q 3 = [g p<? , 3 ]™| = i G GL(m 3 ,F). 

T/*en r = E^T"" ^ fc M ® %-, 2 v fc , 3 and 2*3 = [t^]™ = £f = i ?W,sT,. 

Let [v^j, . . . , v mi) j] 6e a tasis m Uj snc/i toai TjUjc = span^i^, . . . , v rjj j) /or 
z = 1,2,3. Then r = Y^^k™ 3 Ujk^i,i © Vj j2 (g v fc , 3 and T fej3 := [t^fc]™^- 2 G 
F miXm2 for k = 1, . . . , m 3 . T/ien T fc>3 = /or £; > r 3 and fi )3 , . . . , f rs>3 are ZineaWj/ 

iS 

independent. Furthermore, each Tjt i3 = S k © := 



() , w/iere 5 fc G F riXr2 
for k = 1, . . . , r 3 . Moreover, the span of range Si, ... , range S r3 and the span of 

nrp TF^l nnri H7^2 rv>eTip/>fn?^/ii 

'r 3 



range 5^, • • • , range Sj are F ri and F r2 respectively. 



The following result is a very useful characterization of the rank of 3-tensor. 

Theorem 2.4 Let r G Ui (g U 2 © U 3 6e given oy (2.3,). Fix j G {1, 2, 3}, j c = 
{p,q}. Let T ij:j := [t hi2h ]™ p J™ q =l G F m ^ xm «,^ = l,...,mj. Then rank r is toe 
minimal dimension of a subspace of m p x m q matrices spanned by rank one matrices, 
which contains the subspace spanned by T±j, . . . ,T m .j. 

Proof. It is enough to prove the Proposition for the case j = 3. Proposition 
2.2 and its proof yields that it is enough to consider the case where r3 = 7713, i.e. 
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T± t s, . . . , T m3i 3 are linearly independent. Let r be the dimension of the minimal 
subspace of ra\ x 777-2 matrices spanned by rank one matrices, which contains the 
subspace spanned by Ti )3 , . . . , T m3j3 . 

Suppose that equality (2.4) holds. Since r 3 = 777,3 it follows that zi, . . . , span 
U3. Without loss of generality we may assume that z±, . . . , z m3 form a basis in U3. 
For each / > 7773 rewrite each z; as al linear combination of zi, . . . , z m . A . Thus 

z/ = ^kjZj, I = 7773 + 1, . . . ,k, t = ^(xj (g) yj + ^ b l jX. l ®yi)®z j . (2.6) 

p=l jr' = l «=m 3 + l 

Hence 

fe 

T i,3 = x jyJ + ^2 h i3*iyl > j = 1, . . . , 7773. (2.7) 

/=r«3+l 

In particular, the subspace spanned by Ti )3 , . . . ,T m3 ^ is contained in the subspace 
spanned by k rank one matrices x.iyj , . . . , x^.yj. Therefore r < k, hence r < rank r. 

Assume now that there exist Xj G F" 11 , yj G ¥ m2 ,i = 1, . . . , k such that T p ^ = 
J2i=i a pi x iyJ for p = 1, . . . , 7773. View x^y^ as Xj ® yj. Then 

r = ^(^a p jXj (8>yj) z p = ^Xj ® yj <g> (^a pi z p ). (2.8) 
p=i «=i i=i p=i 

Hence A; > rank r. So rank r = r. □ 



3 Generic rank 

From now and F is either the field of complex numbers C or the field of real numbers 
R, unless stated otherwise. We refer the reader to §8 for the notations and results in 
algebraic geometry used in the sequel. Let Xj G C mi , i = 1,2,3. Then a rank one ten- 
sor xiOx 2 Ox 3 is a polynomial map f : C mi+m2+m:i ->• C miXm2Xm3 = C™ 1 ™ 2 ™ 3 , i.e. 
f(xi,x 2 ,x 3 ) := xi(g>X2®x 3 . Thus we identify a vector z = (z\, . . . , z mi+n!2+m3 ) T G 
C mi+m2+m3 with (xj , xj, xJ) T , which is also denoted by (xi,X2,X3), and a vector 
y G C mim2 ™ 3 with T = [i^ 2 i 3 ]"=™ 3 G C miXm2Xm3 . (Here we arrange the three 
indices of [fj^jg] in the lexicographical order.) Then Df, the Jacobian matrix of 
partial derivatives is given as 

Df( Xl ,X2,x 3 ) = [A 1 (x 2 ,x 3 )|A 2 (x 1 ,x 3 )|^ 3 (x 1 ,x 2 )] G c mim2m3X ( mi+m2+m3 ), (3.1) 

is viewed as a block matrix, where G C m i m 2"i3xmi f or j = i ; 2, 3. More precisely, 
let 

= (^lij > • • • j 1^3 = !)■■■> 

be the standard bases in C mj for j = 1, 2, 3. Then 

Ai(x 2 ,X3) = [ei,i ® x 2 ® x 3 | ■ ■ ■ |e mi ,i ® x 2 ® x 3 ] G C mimam3Xmi , 
A 2 (xi,X3) = [xi®ei ) 2®x 3 |---|xi(8)e m2) 2®X3] G C mim2m3Xm2 , (3.2) 
^ 3 (xi,x 2 ) = [x 1 ®X2®ei, 3 |---|xi®X2®e m3 , 3 ] G C mim2m3Xm3 . 

So the p — th column of ^4i(x2,X3) is the tensor e Pi i®X2®X3. Similar statements 
holds for ^2(xi,X3) and A 3 (xi,X2). 
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Proposition 3.1 Let x; £ C m %i = 1,2,3, and denote by f : C mi x C™ 2 x 

C m 3 _^ cmi xm 2 xm 3 the map f( Xl ,x2,x 3 ) := x x ®x 2 <£>x 3 . /denta/y C mi x C m2 x 
C m 3) pixm2xm 3 rf/j C mi+m2+m3 ,C mim2m3 respectively. Then 

rank Df(xi,X2,X3) < mi + 777.2 + w-3 — 2. (3.3) 
Equality holds for any Xj / /or i = 1,2, 3. 

Proof. Let J 4i(x2, X3), ^(xi, X3), A 3 (xi, X2) be denned as in (3.1). Note that 

mi ni2 m3 

^ x il,l e n,l® X 2® x 3 = ^2 Xi 2i 2Xi^e i2i 2»X3 = ^ £13,3X1 <8x2<8e, 3 ,3 = Xi®X 2 ®X 3 

«1=1 «2=1 13=1 

That is, the columns of Al(x2,X3), ^2(xi,X3) and A 3 (xi,X2) all span the vector 
xi <8 X2 (8 x 3 . Hence the inequality (3.3) holds. 

Choose xi = ei i,X2 = e2,i,x 3 = ei,3. Then in Df (ei,i, ei,2, ei, 3 ) the column 
6i,i<8ei,2<8ei,3 appears three times. After deleting two columns ei,i<8ei,2<8ei, 3 , we 
obtain 777.1+7712+777.2 — 2 linearly independent columns, i.e. rank Df (ei,i, ei,2, ei, 3 ) = 
mi + 7772 + 7773 — 2. If xi, X2, X3 / 0, then each x, can be extended to a basis in C mi . 



Hence equality holds in (3.3). □ 

Let A; be a positive integer and consider the map f^ : (C mi x C m ' 2 x C mi ) k — > 

C mixm 2 xm 3 given by 

k k 
ffe(xi,i,Xi,2,Xi, 3 ,.. . ,X fe ,i,X fc , 2 ,X fe , 3 ) = ^f(x;,i,Xz, 2 ,Xz, 3 ) = ^ X;,i (8 X;, 2 <8 X Jj3 , 

1=1 1=1 

Xiij eC m + j = 1,2,3, 1 = 1,. ..,k. (3.4) 



In this paper the closure of a set S C F n , denoted by Closure S, is the closure 
in the standard topology of ¥ n . Since f k is a polynomial map it follows. 

Definition 3.2 Let Y k C c m i xm2Xm 3 5 e the closure o/f fc ((C mi x C™ 2 x C m ' A ) k ). 
Denote by r(k, 1711,1712,1113) the dimension of the variety Y k . Let U k £ Yk is the strict 
algebraic subset ofY k , possibly an empty set, such that i k ((C mi x C" 12 x C m3 ) k ) = 
Y k \U k . 

T £ C miXm2Xm3 has a border rank k if T £ Yfc\ y fc-i; where Y = {0}. The 
border rank ofT is denoted by brank T ■ T is called rank ill conditioned i/brank T < 
rank T ■ 

Clearly, r(k, mi, 1712,1113) is a nondecreasing sequence in k £ N. (See for more 
details the proof of Theorem 3.4 and Theorem 4.1.) The notion of border rank was 
introduced in [2]. 

Proposition 3.3 The set of all ill conditioned tensors T £ C miXm2Xma of 
border rank k equals to Uk \ ifc-i- This set is a finite union of quasi-projective 
varieties IC kA , . . . , /C fcj -( fc , mi , m2)m3 ), where dim/C M < r(k,m 1 ,m 2 ,m 3 ) fori = 
l,...,j(k,m 1 ,m 2 ,m3). 

Proof. Recall that Y k \ Y k _\ is the set of tensors of border rank k. Hence 
ffc((C mi x C™ 2 x C m3 ) k )\Y k ^i is the set of all tensor whose rank and border rank 
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are k. By definition is a disjoint union of ffc((C mi x C" 12 x C m3 ) fc ) and JJ\~. 
Hence the set of all ill conditioned tensors of border rank k is Uk \ Yk-i- Since 
Uk is a proper algebraic subset of Y^, it is a finite union of pairwise distinct affine 
varieties. Assume that ICL IC', m m m n are all those varieties which are 

not contained in Y&_i. Then /C^ = /Cj[. j \ for i = 1, . . . ,_?(£;, mi, 7772,7773). 
Since ^CjLj £ Yfc it follows dim/Cj^ = dim/C/^j < dimY^ = r(/c, mi, m 2 , 777-3). □ 
See [9] for related results on rank ill conditioned tensors. The following theorem is 
a version of what is called in literature Terracini 's Lemma [33] . 

Theorem 3.4 Let 1711,1712,1713 > 2 be three positive integers. Assume that 
e ij,j = (^lij > • • • ) ^m 3 j 3 ) T £ C m i ,ij = l,...,mj is the standard basis in C m J for 
j = 1,2,3. Let grank(mi, 7712,7713) be the smallest positive integer k satisfying the 
following property. There exist 3k vectors xn G C mi ,x^2 G C m2 ,x^3 G C m ' A ,l = 
1, . . . , k such that the following k(m\ + m2 + 777.3) tensors span (C miXm2Xm3 .- 

e iu i <8> x i)2 <8> x i>3 , x M ® e i2>2 <8> x^ 3 , x u (g) x i)2 (8) e i3i3 , (3.5) 
ij = 1, . . . , rrij, j = 1, 2, 3, I = 1, . . . , k. 

Then there exist three algebraic sets U C V C C c miXm3Xm3 = C™ 1 " 12 ™ 3 
S7tc/i i/iai £/ie following holds. 

1. Any T = [ijii 2 i 3 ] £ C TniXm2X " 13 \[7 /tas ranft grank(mi, 777 2 , 7773) at most. 

2. Any T = [^ii 2 i 3 ] G c miXm2Xm3 \y /ias exactly rank grank(777i, 7772, m 3 ). 

5. Zet T = [ti^] G C miXm2Xm3 \W. T/ien rank T = grank(mi, 777 2 , 7773). Fur- 
thermore the set of all 3grank(mi, 7772, 7773) vectors 

X U G C™ 1 , X,, 2 G C" 12 , X,, 3 G C" 13 , Z = 1, . . . , grank(777 1 , 7772, m 3 ) 

satisfying the equality 

grank(mi ,m,2 ,1113 ) 

T= Yl x Zjl x ij2 ® x /j3 (3.6) 
1=1 

is a union of degffc of pairwise disjoint varieties Ti(T) Cj (C mi x C" 12 x 

(£to 3 -jgrank(mi, m 2 ,m 3 ) f di mens i on (mi +m 2 + m3)grank(mi , 777 2 , 777,3) — 777im 2 7773 

/or i = l,..., deg ffc. Fiew eac/i ranA; one tensor x^i £3 x; )2 <g) x/ )3 as a point in 
(C\{0» xCF mi ~ l xCP™ 2 " 1 xCF 3-1 . T/ien t/te set of all grank(mi, m 2 , m 3 ) 
ran/c one tensors 

( x l,l ® x l,2® x l,3) • • • j x grank(mi,m2,«i-3),l ^ x grank(m,i ,m2, m.3), 2 ^ x grank(rrti ,7712,013), 3) 

in (C\{0» x PC" 11 " 1 x PC™ 2 " 1 x PC" 13 " 1 satisfying (3.6) is a disjoint union 
o/degffc varieties each of dimension (mi + m 2 + 7713 — 2)grank(mi, m 2 , 777,3) — 
?77 1?77 2 777,3. 

Proof. (3.1) yields that 

Df fe (xi ) i, . . . ,x fcj3 ) = [y4i(xi i2 ,xi > 3)|A 2 (xi i i,xi i 3)|A 3 (xi i i,xi i2 )| . . . (3.7) 

|Ai(x fci 2,X fe)3 )|A2( x fe,l, x fc,3)l^3( x fc,l, x fe,2)]- 
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Moreover the column space of is spanned by the vectors (3.5). As in the 
proof of the Proposition 3.1, generically the rank of Dffc(xi i, . . . ,Xfc 3) is equal 
to r(k, mi, m2, ms). Thus, there exists a strict algebraic set Xk ^ (C mi x C" 12 x 
C m3 ) fc such rank Df fc (xi 5 i, . . . ,x fci3 ) = r(k, mi, m 2 , m 3 ) for any (xi,!, . . . , x fcj3 ) G 
(C mi x C™ 2 x C m3 ) k \X k and rank Df fc (xi,i, . . . , x fcj3 ) < r(k,mi,m 2 ,m 3 ) for any 
(xi 5 i, . . . ,x fe)3 ) G X fe . 

Let A; = 1. Then Proposition 3.1 yields that generically rank Dfi(xi ) i, xi^, xi )3 ) = 
mi + m 2 + m 3 — 2. Hence fi(C mi x C" 12 x C™ 3 ) is a quasi-projective variety of 
dimension mi + m 2 + m 3 — 2. (In this case it is straightforward to show that 
/i(C mi x C™ 2 x C" 13 ) is a variety.) If mi + m 2 + m 3 - 2 = mim 2 m 3 then fi(C mi x 
C m2 x C™ 3 ) = c miXm2Xm 3 ; grank(mi, m 2 , m 3 ) = 1 and the theorem is trivial in this 
case. That is every tensor T is either rank one or rank zero tensor. 

Assume now that mim 2 m 3 > mi + 771,2 + m 3 — 2. Then /i(C mi x C 1 " 2 x 
C" 13 ) C C m i x ™2xm3 i s a strict subvariety of tensors of rank 1 at most. Since 
ffc(xi,i,...,Xfc j3 ) = fjt+i(xi,i, ... ,x fe)3 , 0,0,0), it follows 

f fc ((C mi x C™ 2 x C ms ) k ) C f fc+ i((C mi x C™ 2 x C m3 ) fc+1 ), k = 1, . . . (3.8) 
and f fc ((C mi x C™ 2 x C m3 ) fc ) = C miXm2Xm3 for fc > 777177727773. 

In particular 

r(k, mi, 777 2 , 7773), k = 1, . . . a nondecreasing sequence, 
r(grank(777i, 777 2 , 7773) — l,mi,m 2 ,m 3 ) < mim 2 m 3 , (3.9) 

r(fc, 7771, 777 2 , 777 3 ) = 777l777 2 777 3 for > grank(777i , 777 2 , 77l 3 ) . 

So 1 < grank(777i, 7772, 7773) < mim 2 m 3 . Furthermore, ^ r ank(mi,m2,m 3 )-i i s a strict 
subvariety of C miX ™ 2X ™ 3 . Since C mi xm2 x ™ 3 is the only variety of dimension mim 2 m 3 
in C miXm2Xm3 it follows that Yfe = C miXm2Xm3 for k > grank(mi, m 2 , m 3 ). 

Let 17 := f7 gran k(mi,m2,m 3 ) as defined in Definition 3.2. Then any T G C miXm2Xm3 \?7 

is equal to some fgrank(mi,m2,m 3 )( x l,l> • • • » x grank(mi,m2,m 3 ),3)) i- e - T is of rank 

grank(?77i, 777 2 , 7773) at most. This proves 1. 

Let V = t/uy grank(miim2im3) _i. Then T G C miXm2Xm3 \F has rank grank(mi, 777 2 , m 3 ), 
i.e. 2 holds. Let T G C miXm2Xm3 \V. Then f g " r Lk( mi , m2 , m3 )( r ) is a nonempty alge- 
braic set of (C mi x C m2 x c m3 )s rank ( mi ' m2 ' m3 ). As stated in §8.1, there exists a strict 
algebraic subset W C c miXm2Xm3 , which contains V, such that the first claim of 3 
holds. 

Recall that rank one tensor x/^ <g) x^ 2 <8> x^ 3 is a point in the manifold (C\{0}) x 
PC™ 1 " 1 xPC™ 2 " 1 xPC™ 3 " 1 of dimension mi + 7772 + 7773 -2. Hence f fc can be viewed 
asamapf fc : ((C\{0» x PC™ 1 x PC™ 2 x PC m3 ) fe ^c miXm2Xm3 . This interpretation 
of ffc, combined with the first part of 3 yields the second part of 3. □ 

Definition 3.5 

• The integer grank(mi, 7772, 7773) is called the generic rank o/TG C miXm2Xm3 . 

• k (< grank(777i, 7772, 7773)) is called small if there is a rank k tensor r of the 
form (2.4) such that the Jacobian matrix at r has rank k(mi + 7772 + 7773 — 2). 
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• k (> grank(mi, m2, 7773)) is called big if there is a rank k tensor r of the form 
(2.4) such that the Jacobian matrix at r has rank the maximal rank 7771777,27773. 

• (1711,1712,1713) is called perfect if k = mi +raT+m3-2 is 0, small integer. 
Corollary 3.6 brank T < grank(mi, 777,2, m^) for any T £ C miXm2Xm3 . 

The generic rank grank(mi, 1712, 777,3) has the following interpretation. Assume 
that the entries of T G C miX ™ 2Xm3 are independent random variables, with nor- 
mal complex Gaussian distribution. Then with probability 1 the rank of T is 
grank(mi, 777,2, "13)- Furthermore, Proposition 3.3 yields that with probability 1 
the border rank of T is also equal to grank(777i, 7772, 7773). 

Since the dimension of any algebraic variety is nonnegative the second part of 3 
of Theorem 3.4 yields the well known result, e.g. [4, Chapter 20]: 



Corollary 3.7 grank(mi, 7772, 7773) > [~- 



rnirii-2iii:i 



mi+m2+m3 — 2 I ' 

The following result is known, e.g. [27, Prop. 2.3], and we give its proof for com- 
pleteness. 

Proposition 3.8 Let mi > l\,m2 > > '3 be positive integers. Then 

grank(?77i, 777 2 , 777,3) > grank(7i, Z 2 , l 3 ). 

Proof. Since grank(777i, 777,2, 777,3) is a symmetric function in 7771,7772,7773, it is 
enough to to show that grank(777i, 7772, 777,3), m i = 1 5 2, . . . is a nondecreasing se- 
quence. Assume that (T^i, . . . , 7) + i 5 i) G (C m2Xm3 ) /+1 is a generic point. Then 
(Ti : i, . . . , T^i) G (C m2Xm3 )' is also a generic point. Theorem 2.4 implies that 
the minimal dimensions of subspaces spanned by rank one matrices containing 
span(Ti 5 i, . . . ^-^^span^i, . . . ,7] 5 i) are grank(/ + l,m 2 ,m 3 ), grank(Z, 777 2 , 7773). 
Hence grank(/ + 1,7772,7773) > grank(/, 777,2, 7773). 1=1 



Proposition 3.9 Let I > 3, 777, > 4 be integers. Then grank(/, 777, 777) > m + 2. 

Proof. Fix 777 > 4 and let <p(t) = f+2 "_ 2 be a function of t > 0. Then <f>(t) is 
increasing. Hence for t > 3 

Sttt, 2 

(p(t) > 6(3) = > 777 + 1 for 777 > 4. 

W W 2777 + 1 

Therefore for / > 3, 777 > 4 grank(/, m, m) > m + 2. □ 

As grank(3, 3, 3) = 5, see (5.4) it follows that grank(7, 777, 777) > 777+2 for I, m > 3, 
which was shown in in [32]. 



4 Maximal rank 



Theorem 4.1 Let mi, 777,2, 7773, k be three positive integers and assume that is 
given by (3.4). Let mrank(777i, 777,2, 7773) be the smallest integer k such that equality 
holds in (3.8). I.e. 

f fc ((C mi x C m2 x C m3 ) k ) = f fe+ i((C mi x C™ 2 x C m3 ) fc+1 ) (4.1) 
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for k = mrank(mi, 7772, 777,3), and 

f fc ((C mi x C" 12 x C m3 ) fc ) C f fc+ i((C mi x C m ' 2 x C m:i ) k+1 ), (4.2) 

/or A; < mrank(mi, rri2, m 3 ). Then the maximal rank of all 3-tensors in c m i xm 2xm 3 
is mrank(mi, rri2, m 3 ), and 

grank(mi, ni2, m 3 ) < mrank(mi, mi, m 3 ). (4-3) 

For each integer k G [1, mrank(mi, m2, m 3 )] the set of all tensor of rank k exactly 
is a nonempty quasi-projective variety ik((C mi x C™ 2 x C m3 ) fe )\ffc_i((C mi x C™ 2 x 
C m3 ) fc ), ({ ((C mi x C™ 2 x C ms )°) := {0};. If strict inequality in (4.3) holds then 
the set of all 3-tensors in C miXm2Xm3 of rank greater than grank(mi, 777.2, ^3) is 
a strict quasi-projective variety jc™i xm 2 xm 3 i Furthermore for each nonnegative 
integer k < grank(mi, 7772, 7773) the following holds: 

dimf fc ((C mi x C m2 x C m3 ) k ) < dimf fe+1 ((C mi x C m ' 2 x C m3 ) fc+1 ). (4.4) 

In particular fork < grank(mi, 7772, 7773) the dimension of the quasi-projective variety 
of all 3-tensor of rank k is 

dimf fc ((C mi xC™ 2 x C mi ) k ) = r(k,m 1 ,m 2 ,m 3 ), (4.5) 

which is the rank of the Jacobian matrix Df^ at the generic point (x^i, . . . ,Xfc 3 ) G 
C miXm2Xm3 , (which is also the maximal rank o/Df fe (xi ! i, . . . ,x fcj3 )j. 

Proof. Assume the notation of Definition 3.2 for k > 0, where Yq := {0} G 
C mixm 2 xm 3)[/o = 0. Suppose that (4.1) holds for k = p. Then any tensor of the 
form Y7i=\ xj,i<8>x/ j 2<8>xj j 3 is of the form £]f=i y*,i®yz,2®y*,3- Hence the rank of any 
tensor is p at most. Thus (4.1) holds for any k > p. The second part of (3.8) yields 
mrank(mi, m 2 ,m 3 ) < m 1 m 2 m 3 , and f fe ((C mi xC™ 2 xC m3 ) fc ) = C miXm2Xm3 for k = 
mrank(mi, 7772, 7773). Thus the rank of any 3-tensor is at most mrank(mi, 7772, 7773). 
From the definition of mrank(mi, 7772, 7773) we deduce (4.2). That is for each integer 
k 6 [1, mrank(mi, 7772, 777,3)], %k '■= (Yk\Uk)\(Yk-i\Uk-i) is the nonempty quasi- 
projective variety of rank k tensors. 

From the definition of q := grank(mi, 7772, 777,3) we deduce that = C TraiXm2Xm3 
for k > q. Hence f fc ((C mi x C m ' 2 x C m3 ) k ) = C miXm2Xm3 \U k , k > q, where each U k 
for k > q is an algebraic set satisfying 

U q 2 U q+ i 2 • • • 2 ^mraiik(mi,m 2 ,m 3 ) = 

(Note that Uk = for k > mrank(777i, 7772, 7773).) 

We now show (4.4) for k < q. Definition 3.2 implies the equality (4.5). Assume 
to the contrary that r(k, 7774, 777,2, ^3) = r(k + 1,7771,7772,7773) for some integer k G 
[l,q—l]. Let s be the smallest positive integer satisfying this condition. Then there 
exists an algebraic set X s C (C mi x C m2 x C m3 ) s such that rank Df a (xi ) i, . . . , x Sj3 ) = 
r(s, mi, 7772, ^13) for any (x^i, . . . , x S;3 ) G (C mi x C m2 x C m3 ) s \A s . I.e., s(mi +777-2 + 
7773) tensors given in (3.5) span r(s, mi, 777-2, m 3 ) dimensional subspace in c miXm2Xm 3 
for any (xi,i, . . . ,x Sj3 ) G (C mi x C™ 2 x C m3 ) s \A s . 

Let (xi,'i, . . . ,x s +i >3 ) G (C mi x C" 12 x C m3 ) s+1 . Then 

rank Df a+ i(xi ) i, . . . ,x s+ i j3 ) < r(s + l,m 1 ,m 2 ,m 3 ) = r(s,m 1 ,m 2 ,m 3 ). 
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I.e., (s + l)(mi + m2 + 777,3) tensor given in (3.5) span at most r(s, mi, 7772, m 3 ) di- 
mensional subspace in c miXm2Xm3 . Assume that (x^i, . . . ,x Sj3 ) G (C mi x C m2 x 
C m3 ) s \X s . Then (s+1) (7771+777,2+7773) tensor given in (3.5) span exactly r(s, mi, 7772, 7773) 
dimensional subspace in C miX ™ 2Xm3 . Moreover, the s(mi + 7772 + 7773) tensor given 
by (3.5) for k = s span the above subspace. Hence the tensors 

e ili i(g)x s+ i i 2®x s+ i ) 3,x s+ i i i(g)ej 2i 2®x s+ i i 3,x s+ i i i(g)x s+ i i 2(X'ej3 i 3,?: i = l,...,rrij,j = 1,2,3, 

are spanned by s{m\ + 7772 + 7773) tensor given by (3.5) for k = s. 

Let k > s + 1 and consider rank Df^x^i, . . . , x^), which is equal to the di- 
mension of the subspace spanned by k(mi + 7772 + 7773) tensor given by (3.5). Let 
(xi 5 i,...,x S)3 ) G (C mi x C™ 2 x C ms ) s \X s . Then the above arguments show that 
rank Df^x^i, . . . , Xfc )3 ) = r(s, mi, 7772, 7773). Since X s x (C mi xC m2 xC m3 )^ s is an al- 
gebraic set of (C mi xC™ 2 xC m3 ) fc it follows that r(k, mi,m2, ma) = r(s, mi, 777,2, m 3 ). 
This is impossible, since r(s, mi, m2, m 3 ) < 7771777,27773 = r(<7, mi,m2, m 3 ). Hence 
(4.4) holds for fe < g. □ 

Combine the arguments of the proof of Theorem 3.4 with the results in §8.1 to 
obtain. 

Theorem 4.2 Let mi, 777,2,7713, A; 6e /j/iree positive integers and assume that ffc 
is given by (3.4)- Suppose that k < grank(mi, 777,2, m 3 ). Let T G £ r rn 1 xm 2 xm 3 ^ 
a generic tensor of rank k, i.e. a generic point in ffc((C mi x C" 12 x C m:3 ) k ) C 
pmixm 2 xm 3i Then the set of all possible decomposition of T as a sum of k rank one 
tensors is a disjoint union of deg fk varieties of dimension k(mi + 7712 + m 3 — 2) — 
r(k, mi, 777.2, 777 3 ). In particular, if r(k, mi, 7712, m 3 ) = &(mi + m2 + m 3 — 2), i.e. fc 
is small, then T can be decomposed as a sum of k-rank tensors in a finite number 
of way given by a number N(k, mi, m2,m 3 ) = degffc. 

We remark that in the case r(k, mi, m2, m 3 ) = k(m\ +7772 + m 3 — 2) the positive 
integer N(k, mi, 777,2, 7773) is divisible by A;!, since we can permute the k summands 
in (2.4). If N(k, mi, 777,2, 7n 3 ) = fc!, this means that a generic rank fc tensor T has 
a unique decomposition to k factors. As we can see later,the numerical evidence 
points out that the equality r(k, mi, 777,2, m 3 ) = k(m\ + m2 + m 3 — 2) occurs for 
many k < grank(mi, m,2, m 3 ). 



11 



5 Known theoretical results 



The following results are known. See the references below. 

grank(mi, m 2 , m^) = min(m,3, 77717772) if 7723 > (mi — l)(m2 — 1) + 1, (5.1) 
in particular grank(2, 777-2, "13) = min (7773, 27772) if 2 < 7772 < 7773, (5.2) 
12t7 2 12d 2 

grank(3, 2p, 2p) = T^yl and L^yJ is small, (5.3) 

grank(3,2p + l,2p+l) = f ^±i£ ] + 1, (5.4) 

(77, 77, 77 + 2) is perfect for 77 / 2 (mod 3), (5.5) 
(77 — 1, 77, 77) is perfect for 77 = (mod 3), (5.6) 

4?77 2 

grank(4, 777, m) = l" 2m + 2 "l» ( 5 - 7 ) 

3 3 
77 - 77 

grank(n, 77, 77) = [~- -] and [- -J is small for for (5-8) 

(7771, 2m' 2 , 2777 3 ) perfect if — I is integer , (5.9) 

777l + Z7772 + Z7773 — Z 

where (2.2) holds. 

See [6] for (5.1), [27] for (5.3- 5.6), [4] for (5.7), [22] and [1, Theorem 5.3] for 
(5.8-5.9). Note that in view of (5.1) 

(?77i,?772, (mi — 1)(tt72 — 1) + 1) is perfect. (5.10) 

We bring another proof of (5.1) using matrices in §6. It was conjectured in [10]. 

Conjecture 5.1 Let 3 < m\ < 777,2 < 7773 < (mi— l)(m 2 — 1) and (7771,7772,7773) 7^ 
(3, 2p + 1,277 + 1), p €N. T/iengran^mx, 7772, 7773) = L1ZTC3-2 I • 

Combine Corollary 3.7, Proposition 3.8 and (5.10) to deduce. 
grank(?77i, 7772, 7773) = |~ m i m 2"T,3 , _ grank / mi)m2)m3 + i\ (5.11) 

7771 + 7772 + 7773 — 2 

for 7773 = (7771 — 1)(?772 — 1) and 3 < 7771,7772- 

I.e., the above conjecture holds for 7773 = (mi — 1)(?772 — 1). A more precise version 
of Conjecture 5.1 is 

Conjecture 5.2 . Let the assumptions of Conjecture 5.1 hold. Then any integer 
k g [2, r gagaaa 1 _ 1] is sma ll. 

We call (mi, 7772, 7773) regular if (mi, 7772, 7773) satisfies Conjecture 5.1 and L mi +raT+m3-2 -l 
is small. 

We verified numerically 1 the above two conjectures for mi < 7772 < 7773 < 
14 as follows. We chose at random k G [2, \ m ^^^_ 2 \\ vectors x M £ (Zn 



x l thank M. Tamura for programming the software to compute grank(mi, m2, m-j) and 
r(fc, mi, m,2, 1713). 
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[— 99,99]) m Si = 1,2,3, I = 1,... , k such that the rank of the Jacobian matrix at 
the corresponding rank k tensor 

k 

T = 5^x, i i®x Ji 2®xj i 3 (5.12) 
1=1 

was min(fc(mi + m,2 + 7773 — 2), 7771777,27773). See also [7] for numerical results. 

The values of mrank(mi, 777-2, ^3) are much harder to compute. The following 
results are known. First, [20, pTO], (see also [17]), 

77 

mrank(2, m, n) = m + min(m, |_— J ) for 2 < 777 < 77. (5.13) 
Second, it is claimed in [24] that 

mrank(3, 3, 3) = 5 (5.14) 



6 Matrices and the rank of 3-tensors 

In this section we use known results for matrices to find estimates on the generic 
and maximal rank of tensors. 

Proposition 6.1 Let Uj be mi-dimensional vector space over ¥, for i = 1, 2, 3. 
Then mrank(mi, 7772, 7713) = m\ni2 for m\mi < 7773. More -precisely, let r G Ui (g> 
U2<8>U3 be given by (2.3). Let R\,R2,R3 be defined as in Proposition 2.2. Assume 
that i?3 = R\R2- Then rank r = R\R2- 

Proof. Since F miXm-2 is spanned by 7771777,2 rank one matrices, Theorem 2.4 
yields that mrank(mi, 7772, 7773) < 77717772. Choose r represented by (2.3), such that 
T 1A , . . . ,T mii i G F m2Xm3 span C m2Xms . Theorem 2.4 yields that rank r = 77117772, 
i.e. mrank(?77i, 7772, 7773) = 77727773. The second part of the proposition follows from 
Proposition 2.2. □ 

(The above results in this section hold for any field F. We remind the reader 
that from now and on F = K, C.) We now show how to deduce (5.1) using matrices. 
For a finite dimensional vector space U over F of dimension N denote by Gr(/c, U), 
the /c-Grassmannian, the manifold of all k dimensional subspaces of U. (k G [0, N].) 
Note that Gr(l,F mxn ) can be identified with pF mri_1 , a complex projective space 
of dimension mn - 1. Equivalently, if mx „ 7^ A G F mxn , then A G Gr(l,F mxri ) 
corresponds to all points tA,t G F\{0}. Note that rank A = rank tA for any t G 
F\{0}. Thus we define rank A := rank A. Usually we will identify A G Gr(l, F mxri ) 
with one of tA G F mxn \{0} and no ambiguity will arise. 

Let L C F mxri be a subspace of dimension d > 1. Then proj L C Gr(l, F mxri ), 
the set of all one dimensional subspaces in L. The dimension of proj L is d — 1 and 
proj L can be identifies with PF^" 1 . proj L is called a linear space in proj F mxn . 
The following result is known [15, 11]. 

Theorem 6.2 Let Ufc jmj7l (F) C F mxri be the set of all m x n matrices of rank 
k at most. Then Ufc jm>n (F) is an irreducible variety of dimension k(m + n — k). 



13 



Furthermore, Ufc imi „(F)\Ufc_i !min (F) is quasi-projective variety of all matrices of 
rank k exactly, which is a manifold of dimension k(m + n — k). 

Any complex subspace of L C C mxn of dimension (m — k){n — k) + l contains a 
nonzero matrix of rank k at most. More precisely, for a generic subspace L C C mxn 
of dimension (m — k)(n — k) + \, the linear space proj L contains exactly 

n—k—l (m+j\ n—k—1 , -w -\ 

n {m-k) TT (m + jy.jl 

fm-k+j)- 11 ( k +j)l(m-k+j)V 
j=0 V m-k ) j=0 y J ' v J > 

distinct matrices of rank k exactly. 

Theorem 6.3 Let 2 < m,n and d 6 [(m-l)(n-l) + l,mn-l] be fixed integers. 
Then a generic subspace L C C mxn of dimension d is spanned by rank one matrices. 

Proof. We first consider the case d = (m— l)(n— 1) + 1. It is not difficult to check 
that d < 7i )m , n . Let L be a generic subspace L of dimension (m — l)(n — 1) + 1 Then 
-^H Uk jmjTl (F) = {A±, . . . , ^4 7l m n } be a set of 7i, m , n distinct matrices. We claim any 
<i matrices out of these matrices are linearly independent. Note that if we perturb L 
to V then V PI J7fc, m ,n(^) = {^ii . . . , A! m n } is a perturbation of Ai, . . . , Ad- Take 
.Ai, . . . , Ad and perturb them to d linearly independent matrices Bi, ... , i?^. Note 
that there is unique subspace L\ which spanned by B±, . . . , Bd- Hence L\ is equal 
to some L'. This shows that generically Ai, . . . , Ad are linearly independent. Hence 
any d matrices out {A\, . . . , A 7l mn } are linearly independent. Therefore a generic 
L of dimension (m — l)(n — 1) + 1 is spanned by rank one matrices. 

Assume now that L is a generic subspace of dimension d G [(m — l)(n — 1) + 
2,mn — 1]. Then L n C/fe, m ,n(F) is a variety of dimension d — (m — l)(n — 1) — 1. 
Similar arguments show that any d generic matrices in L Pi E/jfc, m , n (F) are linearly 
independent. □ 



Corollary 6.4 

1. (5.1) holds. 

2. grank(mi, m,2, (mi — l)(m2 — 1)) = (mi — l)(m2 — 1) + 1 /or m\,m2 > 2, i.e. 
(5.11) holds. 

Proof. In view of Proposition 6.1 we discuss first the case m.3 € [(mi — l)(m-2 — 
1) + l,mim2 — 1]. View a generic T = [Ujk] € C™ lXm2Xm3 as 7713 generic matrices 
^ = [tijk]TJp e C miXm2 for fe = 1, . . . ,m 3 . Hence L = span(Ai, . . . , A m3 ) is a 
generic subspace of dimension 711,3. Theorem 6.3 yields that L is spanned by rank 
one matrices. Theorem 2.4 yields that grank(mi, 7112, 7113) = 7113. 

Assume now that m 3 = (mi - l)(m 2 - 1) and T = [Ujk] G C miXm2Xm3 be a 
generic tensor. Let L C C miXm2 be the generic subspace defined as above. Theorem 
6.2 yields that L is not spanned by rank one matrices. Hence the minimal dimension 
of a subspace spanned by rank one matrices containing L is at least 7713 + 1. Let 
X G C miXm2 be a generic matrix. Then L\ = span(L, X) is a generic subspace 
of dimension (mi — l)(m 2 — 1) + 1. Hence L\ is spanned by rank one matrices. 
Therefore rank T = 7713 + 1 . □ 
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Corollary 6.5 grank(2, 771,2, rn%) = min (7773, 27772) for 2 < 7772 < 7773. 

We now show how to apply the above results to obtain upper estimates of 
grank(777i, 7772, "73) and mrank(?77i, 7772, 7773). Let us start with the case 7772 = 7773 > 3. 

Theorem 6.6 Let m,n > 3 be integers. Then 

grank(n, 777, 777) < |_^J m + (77 — 2|_^J)(m — |_Vn — lj) if m > 2[Vn - lj (6.2) 

grank(n, 777, m) < 77(777— [Vn — lj ) if m < 2|_Vn — lj < 2(m — 1), (6.3) 
grank(n, ?77, 777) = min(n, m 2 ) if n > (m — l) 2 + 1, (6.4) 

mrank(n, 777, m) < 

Lv^TJ 

(2i-l)(m-i + l) + (m- [V^T\ 2 )(m- [Vn~^T\). (6.5) 

i=l 

Proof. We first discuss the grank(n, 777, 777). Clearly, (6.4) is implied by 
Corollary 6.4. 

Assume now that n < (777- 1) 2 + 1, i.e. 2Lv / ra T7 Tj <2(m-l). Let r € <C nxmxm 
be a tensor of the form (2.3). Assume that (T^i = [tijfc], . . . , T nj i = [injfc]) £ 
(C mxm ) n is a generic point. Let I = \^Jn — lj . So 77 > I 2 + 1. Theorem 6.2 yields 
that span(Ti j i, . . . , T n> i) contains at least ^ m -i,m,m distinct matrices of rank m — l. 
It is straightforward to show that 

7m— i,m,m — n - Since (Tiji, • • • , ^n,i) was a generic 
point we may assume span(Ti j i, . . . , T n> i) contain 77 linearly independent rank 777 — / 
matrices Q±, . . . , Q n . (See the proof of Theorem 6.3.) This gives the inequality (6.3) 
for all n < (m - l) 2 + 1. 

Since T^i, . . . , T n> i are generic, we can assume that T<n-\,\ is invertible and 
■^2i-i l-^ 2 *- 1 ^ s diagonable. Hence ?2j_i i,T2j 1 are contained in a subspace spanned 
by 777 rank one matrices. If Tt is even we obtain that span(Ti 5 i, . . . , T nj i) are contained 
in 7^777 dimensional subspace spanned by rank one matrices. Theorem 2.4 yields the 

inequality (6.2). If 77 is odd, we can assume that Q\ = T n> \ — J2i=i ^,1 ^ as a ^ ran k 
777 — [\/n — lj . Hence, we deduce (6.2) in this case too. 

We now prove the inequality (6.5). We assume the worst case which will give the 
upper bound. So it is enough to consider the case where Ti ) i,T2 ) i, . . . , T n> i linearly 
independent. Now we choose a new base Si, . . . , S n in span(Ti 5 i, . . . , T n ^) such that 
rank S\ > rank S2 > ■ ■ ■ > rank S n . So the worst case is rank Si = m. Since any 2 
dimensional space contains a singular matrix we can assume that rank Si < 777 — 1 
for i = 2,3, 4. According to Theorem 6.2 any 5 dimensional vector space contains a 
nonzero matrix of rank 777 — 2 at most. Hence rank Si < m — 2 for i = 5, 6, 7, 8, 9. 
Theorem 6.2 implies that any subspace of dimension 10 contains a nonzero matrix of 
rank 777 — 3. Hence rank Si < m — 3 for i = 10, . . . ,. Continuing the use of Theorem 
6.2, and combing it with Theorem 2.4 we deduce (6.5). □ 

Use Corollary 3.7, Proposition 3.8 and the above theorem to deduce: 
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Corollary 6.7 



4 < grank(3, 3, 3) < 5 = 1 • 3 + 2, 
grank(4, 3, 3) = 5 (4 = (3 - l) 2 ), 
grank(5,3,3) = 5 (5 > (3 - l) 2 ), 

6 < grank(3, 4, 4) < 7 = 1 • 4 + 3, 
7 < grank(4, 4, 4) < 8 = 2 • 4, 

8 < grank(5, 4, 4) < 10 = 2 • 4 + 2, 

7 < grank(3, 5, 5) < 9 = 1 • 5 + 4, 
9 < grank(4, 5, 5) < 10 = 2 ■ 5, 

10 < grank(5, 5, 5) < 13 = 2 • 5 + 3, 



mrank(3, 3, 3 
mrank(4, 3, 3 
mrank(5, 3, 3 
mrank(3,4,4 
mrank(4, 4, 4 
mrank(5, 4, 4 
mrank(3, 5, 5 
mrank(4, 5, 5 
mrank(5, 5, 5 



<7 = 3 + 2 + 2, 
<9 = 3 + 2 + 2 + 2, 

< 10 = 3 + 2 + 2 + 2 + 1, 

< 10 = 4 + 3 + 3, 

< 13 = 4 + 3 + 3 + 3, 

< 15 = 4 + 3 + 3 + 3 + 2, 

< 13 = 5 + 4 + 4, 

< 17 = 5 + 4 + 4 + 4, 

< 20 = 5 + 4 + 4 + 4 + 3. 



Recall that in all the examples of grank(n, m, m) given by Corollary 6.7 we know 
that grank(3, 3, 3) = 5, grank(3, 5,5,) = 8, while all other values of grank(n, m, m) 
are given by the lower bound. It is claimed that mrank(3, 3, 3) = 5 [24]. 

Note that if n is even and m » n then the upper bound (6.2) combined with 
Corollary 3.7 implies that grank(n, m, m) is of order ™. However if n = 0(m l+a ) 
for a G (0, 1] then the upper bounds (6.2-6.3) are not of the right order, (which is 
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7 Typical ranks of real 3-tensors 

The study of the rank of a real 3-tensor is closely related to the real semi-algebraic 
geometry. See §8.2 for the results in semi-algebraic geometry needed here. 

Theorem 7.1 The space W miXm2Xm3 , mi, m2,rri3 £ N, contains a finite number 
of open connected disjoint semi- algebraic sets Oi, ... ,Om satisfying the following 
properties. 

1. l miXm2Xm3 \ Oi is a closed semi- algebraic set K miXm2Xm3 of dimension 
strictly less than m\mim?,. 

2. Each T £ Oi has rank rj for i = 1, . . . , M. 

3. min(n, . . . ,r M ) = grank(mi, m 2 , m 3 ). 

4- mtrank(mi, m,2, m^) := max(ri, . . . , tm) is the minimal k £ N such that the 
closure o/f fc ((M mi x M m2 xK m f) is equal to E miXm2Xm3 . 

5. For each integer r G [grank(mi, m<i, m^), mtrank(mi, m2,ms)] there exists r, L = 
r for some integer i G [1, M]. 

Proof. Consider the polynomial map f fc : (C mi x C™ 2 x C m:i ) k -»• £ miXm2Xm:i 
be given by (3.4). Note that f fc : (W ni x E" 12 x R m *) k -»• l™ lXm2Xm3 . Denote by Y k 
and Q k the closure of f fc ((C mi x C™ 2 x C m3 ) k ) and Z k := f k ((M. mi x l™ 2 x M m 3) fc ) 
respectively. Clearly, 

y.rV.,, O C O -,i for ?' P N Y _ pmixm 2 xm 3 ^ _ R miXm 2 xm3 



16 



Let mtrank(mi, ?7i2, m.3) be the smallest k such that Qu = ]R miXm2Xm 3. 

Let q = grank(mi, m2, 7713). Then Y q _\ is a strict complex subvariety of c m i xm 2xr 
(See Definition 3.2.) In particular Yf_ 1 = Y 9 _i n l miXm2Xm3 is a strict real subva- 
riety of l™i x ™2 xm 3. Hence Q q -\ C Y q K _ 1 is a semi-algebraic of dimension dim Y 9 _i 
at most, which is strictly less than 777177727773 — 1. In particular 

mtrank(mi, m2, m.3) > grank(?77i, 7772, 7773). (7.1) 

From the proof of Theorem 4.1 it follows that there exists an algebraic subset X q C 
(C mi x C" 12 x C m3 ) 9 such that rank Df, is 777177727773 at each point of (C mi x C™ 2 x 
C m3 )i\X q . Then Xf = X q n (M mi x M m2 x M™ 3 )" is a real algebraic set of (M mi x 
R m 2 x M m 3 )g. Thus t he Jacobian of the real map f q : (R mi x W 11 ' 2 x R m «) fc -> 
|mixm 2 xm 3 rnim^m^, at each point of the open semi-algebraic set P q := 

(W ni x R" 12 x M m3 )«\X^. Hence f q (P q ) is an open semi-algebraic set in r iXra2Xm3 . 
Therefore fg(P 9 )\y ? R 1 is an open semi-algebraic set in r iX ™ 2Xm3 . Clearly Q q \ 
Qq-i 5 Q Q \Y q R _ l D f q {P q )\Y^_ v Hence the interior of Q q \ Q q -i, denoted as 
int {Q q \ Qq-i) is an open semi-algebraic set, which consists of tensors of rank q 
exactly. The theory of semi-algebraic sets implies that int {Q q \ Q q ~\) = U^f\Oj, 
where each Oi is an open semi-algebraic set. Observe next that the semi-algebraic set 
{Q q \Q q -i) \int {Qq\Q q -i) has dimension 777 1 77727773 — 1 at most. Since dim Q q -\ < 
777 i7772?773 — 1 we deduce that 

dimQ q \ Closure(U^\Oi) < ra x m 2 m z - 1. (7.2) 

Suppose Q q = R™ixni2xm 3) j e equality holds in (7.1), so M = M x . We claim that 
W q := M miXm2X ™ 3 \ Closure(U^ 1 1 O i ) is an empty set. Otherwise W q is a nonempty 
open semi-algebraic set. Hence dimWg = m\m 2 mj, which contradicts (7.2). The 
proof of the theorem is completed in this case. 

Assume now that Q q C R miXm2Xm3 . Recall that dim Closure(S') \ S < dim 5 
for any semi-algebraic set. Hence dimQ 9+ i = dimZ g+ i. We claim that dim(Z y+ i \ 
Q q ) = 777177727773, i.e. the interior of Z q+ \ \ Q q contains an open set. Assume to the 
contrary that that &\m{Z q+ \ \ Q q ) < ■mxm^m^. Hence dim(Z 9+ i \ Z q ) < 777177727773, 
(dim Q q \Z q < dim Z q = 777177727773.) So a sum of generic q + 1 real rank one tensors 
is a sum of generic q real rank one tensors. Hence a sum of generic 777177737773 rank 
one tensors is a sum of q generic rank one tensors. So Q q = K ra i xra2Xm 3 i which con- 
tradicts our assumption. Thus, the interior of Q q +\ \ Q q is an open semi-algebraic 
set, which is a union of disjoint open connected semi-algebraic sets Omi+i, ■ ■ ■ , Om 2 - 
Note that the rank T £ Oj is grank(mi, 7772, 7773) + 1 for j = Mi + 1, . . . , M 2 . Con- 
tinue in this manner we deduce the rest of the theorem. □ 

Definition 7.2 Let r be a positive integer. T 6 K m i xm2X ™3 Ji as a border rank 
r, denoted as brank T, i/T € Closure f r ((M mi xl" 12 x M m3 ) r ) \ Closure f r _i((M mi x 
i™ 2 xr 3 ) r_1 ). ffo((K mi xi™ 2 xl m3 )° = {0}.; r is called an (mi,m 2 ,m 3 ) typical 
rank, or simply typical rank, if r G [grank(mi, 7772, 7773), mtrank(mi, 7772, 7773)] . 

The proof of Theorem 7.1 yields. 

Corollary 7.3 Assume that the entries of T £ W mi xm 2 xm -3 are independent 
random variables with standard normal Gaussian distribution. Then the probability 
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that rank T = r is positive if and and only if r is a typical rank. Assume that 
r is a typical rank. Then the probability that rank T > brank T , provided that 
(rank T — r) (brank T — r) = 0, is 0. In particular, the probability that rank T = 
grank(mi, ?7i2, 777.3) is positive. 

The last part of this Corollary is shown in [32, Appendix B] for 777 1 = 777,2 = 
4, 7773 = 3. For I = 2 < m < n the following is known: mtrank(2, 777, 777) = 
grank(2, 777, m) + 1 = 777 + 1 [28] and mtrank(2, 777, 77) = grank(2, 777, 77) = min(n, 2m) 
for 777 < 77 [31]. [24] claims that mtrank(3, 3, 3) = grank(3, 3, 3) = 5. It is shown in 
[30] that mtrank(3, 3, 5) = grank(3, 3, 5) + 1 = 6. For other additional known results 
for typical rank see [7]. In particular, mtrank(4,4, 12) = grank(4, 4, 12) + 1 = 12 [7, 
Table I]. We now give additional examples, where a strict inequality holds in (7.1). 
All of them, except the above mentioned examples, are new. 

Theorem 7.4 In the following cases mtrank(mi, 777,2, 777.3) > grank(mi, 7772, 7773). 

1. 777i = 7772 = 777 > 2, 7773 = (777 — l) 2 + 1. 

2. 777i = 7772 = 4, 7773 = H, 12. 

We do not know if mtrank(?77, 777, (to — l) 2 + 1) = grank(m, m, (777 — l) 2 + 1) + 1 
for 777 > 4. To prove Theorem 7.4 we need a few auxiliary results. The following 
result is known, e.g. [11, Proposition 5.2]. 

Proposition 7.5 Let F = C, R, n > 2, p > 1 be integers and assume that p < 
[^J . Let proj A n (F) D proj W2 P: „(F) be the projective variety of all (nonzero) skew 
symmetric matrices and the projective subvariety of all skew symmetric matrices 
of rank 2p at most respectively. Then proj W2 Pi „(F) is an irreducible projective 
variety in proj A n (F) of codimension ( n ~ 2 2p ) ■ The variety of its singular points is 
proj W 2 (p_i), n (F). 

Corollary 7.6 A generic subspace L of the linear space ofnxn skew symmetric 
matrices A n (F) CF" X " of dimension ( n ~ 2 2p ) does not contain a nonzero matrix of 
rank 2p at most. In particular, for each generic point T := (T\ , . . . , T^ n -2 P ^) G 

A ra (F)v 2 ) ) there exists an open neighborhood of O C A n (F)v 2 ) such that for 
each X := {X\, . . . , X^i-2 P -j) € O, L(X) := span(ATi, . . . ,X/ n -2 P \) is a subspace of 

dimension of ( n ~2 P ) which does not contain a nonzero matrix of rank 2p at most. 

Proof. A subspace L C A n (F) of dimension d induces a linear space proj L of 
dimension d — 1 in the projective space proj A n (F). Hence the dimension count 
implies that proj L n PW2 Pi „ (F) = for a generic subspace L of dimension ( n ~ 2 2p ) ■ 
Hence L does not contain a nonzero matrix of rank 2p at most. 

A generic point T G A n (F)v 2 ) generates a generic subspace L(T) of dimension 
( n ~ 2 2p )- Hence proj L(T) n proj W2 PiR (F) = 0. For a small enough open neighbor- 
hood O of T, for any XgO, the subspace L(X.) is a perturbation of L(T). Hence 
proj L(X)D proj W 2p ,„(F) = 0. □ 

It is well known that for F = R the above corollary can be improved for certain 
values of 77,77. See [11] and the references therein. We now bring a well known 
improvement of the above corollary for n = 4, p = 1. 
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Proposition 7.7 There exists an neighborhood O of T = (Ti, . . . , TJ) G A4(R)' 
suc/i i/icti /or any X = (X\, . . . , A/) G A4(M) Z £/ie subspace T(X) does no£ contain a 
matrix of rank 2 /or ^ = 2, 3. 



Proof. Let I = 3 and 
10 0' 



Ti = 



-10 
1 
0-10 



,T 2 = 



10 

-1 

-10 
1-00 



1 
10 
0-100 
-10 



Let T = (Ti,T2,Ts). Note that any nonzero matrix B G L(T) is a multiple of 
an orthogonal matrix. Hence rank B = 4 and dimL = 3. Thus proj L(T) Pi 
proj W 2 ,4(M) = 0- Therefore, there exists a small open neighborhood O of T such 
that for any X = (X 1 ,X 2 , X 3 ) G O proj L(X) n proj W 2 , 4 (K) = 0. 

Similar results hold for I = 2 if we let T = (Ti,T 2 ). □ 
The next result appears in [12]. 

Proposition 7.8 Let S raj o C M nxn 6e the subspace of real symmetric matrices of 
trace zero. Then S raj o is & n ^ n+ ^ n — 1 dimensional subspace which does not contain 
a rank one matrix. 

Proof. Clearly, dimS nj o 



(n+l)n 



1. Assume to the contrary that a rank one 
matrix B is in S„ 5 o- Since B is symmetric B = ±xx T , where / x G W 1 . Then 
trace B = ±x T x = 0. So x = 0, contradicting our assumption. □ 



Proof of Theorem 7.4. We first begin with the case (m,m,l = (m — l) 2 + 1). 
Assume first m = 2,3. Note that dimS m = /. Choose a basis Ti,... ,7} in S m . 
Let T = (Ti, . . .,T[). Proposition 7.8 yields that proj S„ i0 n proj U lt „ hm = 0. The 
arguments of the proof of Corollary 7.6 yield that there exists an open neighbor- 
hood O of T G (R mxm y go that for each x = G (l mxm )' we have 

proj T(X) n proj Ui ;7n;m = 0. Hence T(X) is not spanned by rank one matrices. 

Let T = [Ujk] £R mxmxl be the set of C C M mxmxi of all 3-tensors such that 
X G O, where X^ := [tykJ^L^i ^ or ^ = 1 5 • • • ^- Clearly, C is open. Theorem 2.4 
implies that the rank^T > I for each T G C. In view of Theorem 7.1, C has a 
nontrivial intersection with at least one 0{. Hence r\ > I = grank(m, m, I). 

Assume now that m > 3. Let L\ C A m (R) be a generic subspace of dimension 
( m ^ 2 ). Then L\ does not contain a matrix of rank 2. Clearly S mi o H L\ = {0 mX m}- 
Then L = SVn.o + L\ is I = (m — l) 2 + 1 dimensional subspace of trace zero matrices. 
Observe that if B G L then B T G L. We claim that L does not contain a rank 
one matrix G R mxm . Assume to the contrary that B G T is a rank one matrix. 
Proposition 7.8 implies that B S mi o- So 

5 = B 1 + B 2 , Bi = ±(B + B T ) G S m , , B 2 = 1(B - B T ) G Li. 

Since B is a rank one nonsymmetric matrix i?2 is a skew symmetric matrix of rank 
2. This contradicts our assumption. Hence proj L n proj ?7i, m , m = 0. The above 
arguments show that mtrank(m, m, /) > / = grank(m, m, I). 

Assume finally that m = 4 and I = 11, 12. Repeat the above arguments where 
Li has dimension 2 or 3, as given in Proposition 7.7. □ 
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8 Appendix: Complex and real algebraic geometry 



In this section we give basic facts in complex and real algebraic geometry needed for 
this paper. The emphasize is on simplicity and intuitive understanding. We supply 
references for completeness. Our basic references are [23] and [25] for complex 
algebraic geometry, and [3] for real algebraic geometry. 

We first start with some general definitions which hold for general field F. De- 
note by ¥[x\, . . . , x n ],¥(xi, . . . , x n ) the ring of polynomials and its field of rational 
functions in n variables x±,...,x n with coefficients in F respectively. We will iden- 
tify F[x] = ¥[xi, . . . , x n ],F(x) = ¥(xi, . . . ,x n ), where x = (xi, . . . ,x n ) T G F n . For 
Pi,...,p m e F[x] denote by Z(p 1 ,...,p m ) = {y G ¥ n , pi(y) = 0,i = l,...,m}. 
Equivalently let P = (pi, . . . ,p m ) T be a polynomial map P : F ra — > ¥ m . Then 
Z(pi, . . . ,p m ) = P _1 (0). V C F n is called an algebraic set, if V = Z(p\, . . . ,p m ) for 
some pi, . . . ,p m G F[x]. Note that and F ra algebraic sets. 

Recall that PF n , the n-dimensional projective space over F, is identified with one 
dimensional subspaces of F ra+1 , i.e. lines through the origin in F n+1 . So F ra is viewed 
as a subset of PF n where each x = (xi, . . . , x n ) T is identified with a one dimensional 
subspace spanned by x = (xi, . . . , x n , 1) T . PF n can be viewed as the union of two 
disjoint sets F ra and PF n_1 , where PF n_1 is all one dimensional subspaces in F n+1 
spanned by nonzero y = (yi, . . . , y n , 0) T . 

Denote by F/j[y],y = (y\, . . . ,y n+ i) T , the set of homogeneous polynomials in 
Ui, ■ ■ ■ , Vn+i- Let q±, . . . ,q m G ¥ h [y}. Consider the variety Z(q 1 , ...,q m ) C F n+1 . If 
/ y G Z(qi, ...,q m ) then span(y) C Z(qi, ...,q m )- Hence Z(qi, ...,q m ) induces a 
subset Z( gi , ...,q m )C F¥ n . (If Z(q u ...,q m ) = {0} then Z{q u . . . ,q m ) = 0.) V C 
PF n+1 is called a projective algebraic set if V = Z(qi, . . . , q m ) for some q±, . . . , q m G 
F^[y]. It is easy to show that an intersection and union of two affine or projective 
algebraic sets is an affine or projective algebraic. An affine or projective algebraic 
set is called irreducible if it cannot be written as the union of two proper algebraic 
subsets. An irreducible affine or projective algebraic set is call an affine or projective 
variety respectively. (An affine variety will be referred sometimes as variety.) Let V 
be a projective variety in PF n , and W C V a projective algebraic set. Then V \ W 
is called a quasi-projective variety. Note that an affine variety Z(pi, . . . ,p m ) can be 
viewed as a quasi projective variety. First homogenize p±, . . . ,p m to pi, ■ ■ ■ ,p m G 
F n [y]. Let W C PF n to be the zero set of y n+ i = 0. Then Z(pi, . . . ,p m ) can be 
identified with Z(pi, . . . ,p m )\W. 



8.1 Complex algebraic sets and polynomial maps 

In this section F = C. Let P = (pi,... ,p m ) : C n — > C m be a polynomial map. 
Denote by DP(x), the derivative of P or the Jacobian matrix of P, the matrix 
[&^]i=j=i - ^ or a va ™t v U C C™ denote rank[/DP = max x£ [/ rank DP(x). Note 
that the set Sing U = {x G U, rank DP(x) < rank^/DP} is a strict algebraic 
subset of U. (Observe that x G Sing U if and only if all minors of DP(x),x G U 
of order rankjyDP vanish.) Sing U is called the set of singular points of U. Let 
iPm) be a variety. The dimension of V, denoted by dimT^, equals 
to n — rank^DP. Then F\Sing V, the set of regular (smooth) points of V, is a 
quasi-projective variety, and a complex manifold of dimension dimF. See [23, §1A]. 
For any variety V and a strict algebraic subset W in V, the quasi-projective variety 
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V \ W is connected [23, Cor 4.16], and its dimension equal to the dimension of the 
complex manifold V \ (W U Sing V), which is dim V. We say that a given property 
holds generically in V, if it holds for each x G V\W, for some strict algebraic subset 
W of V, where W depends on the given property. 

Hilbert basis theorem, (Nullstellensatz) , claims that a countable intersection of 
algebraic sets is an algebraic set [25, p'17]. An algebraic set U C C n is a union of 
finitely many pairwise distinct varieties U±, . . . , Uk, and this decomposition is unique 
[25, Thms 1.3.1, 1.3.2]. We define dim [/ = maxdimC/j. A product of two irreducible 
varieties is an irreducible variety [25, Thm 1.3.3]. Similar results holds for projective 
algebraic sets. 

Let P be a polynomial map as above. From the definition of an algebraic set 
we deduce that for any algebraic set W C C m the set P~ 1 (W) is an algebraic set 
of C n . Denote rank DP = rank C nDP. Then V = Closure P(C n ) is a variety, of 
dimension rank DP. (Here the closure is in the standard topology in C n or R n .) 
Moreover, Sing P = {x G C n , rank DP(x) < rank DP} is a strict algebraic subset 
of C n . Hence P(C n \Sing P) is quasi-projective variety in C m of dimension rank DP. 
Furthermore, there exists a strict algebraic set W C V, such that for each z £ V\W 
the algebraic set P _1 (z) is a disjoint union of fc-varieties U±(z), . . . , U^{z) C C n , each 
of dimension n — rank DP. The integer k is independent of z G V \ W, and is called 
the degree of P [23, Corol. 3.15-3.16]. 

More general, let U C C n be a variety. Then P(U) C C m is quasi-projective 
variety of dimension rank^/DP. This applies in particular to a projections P, where 
P(x) obtained from x be deleting a number of coordinates. See [25, §3-4]. 

8.2 Real semi-algebraic sets and polynomial maps 

A real algebraic set in W l is the zero set of m polynomials pi,...,p m £ ^[ X L 
and is denoted by Z R (pi, . . . ,p m ) C R n . We can view pi,...,p m as polynomials 
with complex variables z = (z±, . . . , z n ) G C n with real coefficients. Then U = 
Z( Pl , . . . ,p m ) = {z G C ra , pi(z) = ... = p m (z) = 0} and U R = Z R ( Pl , . . . ,p m ) = 
U n W 1 . Z R (pi, . . . ,p m ) is called irreducible, if Z(pi, . . . ,p m ) is irreducible. Since 
any algebraic set U C C n is a finite union of pairwise distinct irreducible varieties 
V\ , . . . , Vfc it follows that any real algebraic set is a finite union of irreducible real 
algebraic sets. A set S is called semi- algebraic it is a subset of an algebraic set 
U R C W l cut out by polynomial inequalities S = {x G U R , ^(x) > 0, i = 1, . . . , k} 
where gi,...gk £ M[x]. (Algebraic set is semi-algebraic.) Semi-algebraic sets are 
stable under finite union, finite intersection and taking complements [3, §2.2]. Hence 
if S, T are semi-algebraic subsets of R n then A \ B = A n (M. n \ B) is a semi-algebraic 
set. 

A projection of semi-algebraic set is semi-algebraic [3, Thm 2.2.1]. Hence the 
image of a semi-algebraic set by a polynomial map is semi-algebraic [3, Prop 2.2.7]. 
The closure and the interior of semi- algebraic set are semi-algebraic [3, Prop2.2.2]. 
Every open semi-algebraic subset S of W 1 is a finite union of disjoint open connected 
semi-algebraic sets in W 1 . For more general statement see [3, Thm 2.4.4]. 

The dimension of a semi algebraic set S can defined as follows. There exists a 
finite number of pairwise distinct varieties Vi,...,Vk C C n , such that S = Lif =1 (Vi n 
Si). Furthermore, V{ PI Si is semi-algebraic and contains an open set in V^ R of real 
dimension dim for i = 1, . . . , k. Then dimS* = max dim V£. See [3, §2.8]. For any 
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semi-algebraic set S the following inequality holds dim Closure(5) \ S < dimS" [3, 
Prop 2.8.13]. 
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